The  World  Wide  Web: 

a  new  communication  medium 


□  Thousands  of  servers  and  growing 

□  Millions  of  users 

□  Multiple  applications 

•  Marketing  venue 

•  On-line  publication 

•  Point  of  sale 

•  Customer  service 

•  Community  Center 
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Hello,  anybody  home  ? 


-IX- 


Utoique  Devetopment  Sunos  Sesame  :  Version  0.6.8 


Fife      Options      Navigate      People 


Help 


Place:        Welcome  to  ZD   Exposition  and  Conference  Company 


Address:    http : //www , zdexpos , com/ 


ZD  EXPOS  IS 
PROUD  TO  BRING  YOU 

mnmrnm    mwmWmmm 


5% 


CK^ 
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Virtual  Places™  - 

adding  people  to  the  Web 


UMque  Development  Sunos  Sesame :  Version  ttJS.8 


Rie      Options      Navigate      People 


Help 


ZD  EXPOS  IS 

PROUD  TO  BRING  YOU 

THESE  EVENTS 


itfli.  27-29,  lokyw,  ioEMsn 


Place:        Welcome  to  ZD   Exposition  and  Conference  Company  J^E^ 

Address:    http ;  //www ,  zdexpos .  com/  ^^^ 
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Virtual  Places:  Web  Info  +  Human 
Presence 


□  Web  Information,  combined  with 

□  Human  presence 

□  Live  interaction 

□  Joint  navigati( 
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Virtual  Places  architecture 


-k 


□  Modular  and  open  client  and  server  extension  to  the 
Web 

□  Supports  many  forms  of  live  human  interaction 

•  one-to-one,  groups,  lectures,  guided  tours 

□  Intuitive  point-and-click  interface 

•  join/leave,  initiate/terminate,  navigate  patent  pending 

rendering 


shared  data 

^^—   VKK    — 

data 

navigation 

persistent  address 

CLIENT 

SERVER 
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Applications  for  AOL 


□  "Personal  virtual  home"  for  every  member 

□  Guided  tours  of  AOL  space/the  Web 

□  Sponsored  on-line  events 

•  At  AOL  content 

•  At  any  Web  server  on  the  Internet 

□  Staffed  shopping  malls 
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Personal  home:  a  web  page  turned 
virtual  place 


□  Put  your  own  content 

□  Host  your  friends 

□  "Go  out"  with  friends  (starting  point  for  private 
tours) 
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AOL'Initiated  Public  Events 


□  Enrich  the  experience  using  on-line  events 

□  Theme-based  guided  tours  of  the  entire  Web,  e.g. 

Museums  and  Galleries 

Corporations 

Universities 

Wall  Street 

Government 

□  Lectures,  conferences,  debates 

•  Incorporating  Web  content 
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Pmduct  Status 

AvnerShafrir 

VP  of  R&D,  Ubique 
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Main  R&D  goals  during  95 


□  March  95  -  Windows  Alpha  /  UNIX  final  release 

•  Windows  3. 1/32  bit 

•  Single  VP  server 

•  Basic  functionality 


□  End  of  November  95  -  Final  Release 

•  All  Windows  platforms,  Mac 

•  Multi-servers 

•  Extensions 
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Major  events  during  95 


We  have  modified  the  Virtual  Places  model  along  95: 

□  March  95  -  N+I  demo  &  Alpha  release 

•  10,000  Virtual  Places  installations 

•  Usability  study 

□  The  on-going  process  with  AOL 

•  Integration  with  AOL-client  (May  95) 

•  Community/on-line  services  model 

But  the  main  schedule  was  not  changed 
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Virtual  Places 


Virtual  Places  is  a  cross  platform  application 
eiiYiroiimeiit  supporting  casual  real-time 
communication  and  collaboration  among  people  in 
communities  over  the  World  Wide  Web* 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 

•  Windows 

•  Macintosh 

□  application  environment 

□  supporting  casual 

□  real-time 

□  communication 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  enyironment 

•  Toolbox 

•  Architecture 

•  Extension  to  the  Web 

•  Desk  top  level  (MS office) 

□  supporting  casual 

□  real-time 

□  communication 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  environment 

□  supporting  casual 

•  everyday 

•  non-business  oriented 

□  real-time 

□  communication 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  enviroiimeiit 

□  supporting  casual 
Q  real-time 

•  co-presence 

•  capacity 

□  communication 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  enyironmeiit 

□  supporting  casual 
Q  real-time 

Q  communication 

•  text  chat 

•  audio 

•  video 

•  broadcasting 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  enyironment 

□  supporting  casual 
Q  real-time 

Q  communication 
G  and  collaboration 

•  guided  tour 

•  document  sharing 

•  extensions;  applets 

•  games 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  environment 

□  supporting  casual 
Q  real-time 

Q  communication 
G  and  collaboration 

□  among  people 

•  one-to-one,  1-many,  multiway 

•  pictures,  animation,  3D  avatars 

•  human  extensions  -  (intelligent  agent) 

□  in  communities 

□  over  the  World  Wide  Web. 
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Virtual  Places 


□  Virtual  Places  is  a  cross  platform 
Q  application  enyironment 

□  supporting  casual 
Q  real-time 

Q  communication 
G  and  collaboration 

□  among  people 
□l  in  communities 

•  privately  ;  publicly  in  groups 

•  large  capacity 

•  community  services 

□  over  the  World  Wide  Web. 
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Virtual  Places 


G  Virtual  Places  is  a  cross  platform 
Q  application  environmeiit 

□  supporting  casual 
Q  real-time 

Q  communication 
Q  and  collaboration 

□  among  people 
Q  in  communities 

□  over  the  World  Wide  Web* 

•  In  context 

•  At  scheduled  events 
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Virtual  Places 

□  Virtual  Places  is  a  cross  platform 
Q  application  environmeiit 

□  supporting  casual 
Q  real-time 

Q  communication 

□  and  collaboration 

□  among  people 

□  in  communities 

□  over  the  World  Wide  Web. 
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Vision  &  Benefits 


□  End  Users 

•  As  an  end-user  application,  it  lets  people  meet,  interact  and 
communicate  easily  and  directly  within  the  context  provided 
by  the  Web. 

□  Service  Provider 

•  As  a  communication  channel,  it  enhances  the  human 
dimension  of  the  rich  content  being  published  over  the 
Internet,  providing  a  way  to  bind  people  together  (customer- 
vendor,  author-publisher,  friends  and  colleagues). 

□  Application  Environment 

•  As  open  architecture/platform,  it  encourages  creativity  by 
means  of  open  extensibility,  customization,  and  application 
development. 
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Vision  &  Benefits 


□  End  Users 

•  As  an  end-user  application,  it  lets  people  meet,  interact  and 
communicate  easily  and  directly  within  the  context  provided 
by  the  Web. 

□  Service  Provider 

•  As  a  communication  channel,  it  enhances  the  human 
dimension  of  the  rich  content  being  published  over  the 
Internet,  providing  a  way  to  bind  people  together  (customer- 
vendor,  author-publisher,  friends  and  colleagues). 

□  Application  Environment 

•  As  open  architecture/platform,  it  encourages  creativity  by 
means  of  open  extensibility,  customization,  and  appHcation 
development. 
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Vision  &  Benefits 


□  End  Users 

•  As  an  end-user  application,  it  lets  people  meet,  interact  and 
communicate  easily  and  directly  within  the  context  provided 
by  the  Web. 

□  Service  Provider 

•  As  a  communication  channel,  it  enhances  the  human 
dimension  of  the  rich  content  being  published  over  the 
Internet,  providing  a  way  to  bind  people  together  (customer- 
vendor,  author-publisher,  friends  and  colleagues). 

□  Application  Environment 

•  As  open  architecture/platform,  it  encourages  creativity  by 
means  of  open  extensibility,  customization,  and  application 
development. 
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Ubique  R&D  -  Structure  &  Tasks 

□  Virtual  Places  -  Architecture 

□  Virtual  Places  -  Client 

□  Virtual  Places  -  Technologies  Support 


Technical  ^ 

Communication 
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Ubique  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

Protocol  &  Communication 
Multi  Servers 
Functional  Extensibility 
Shared  Code  Base 
API 

□  Virtual  Places  -  Client 

□  Virtual  Places  -  Technologies 
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Ubique  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

□  Virtual  Places  -  Client 

•  Client  Architecture 

•  Features 

•  UI 

•  Porting 

□  Virtual  Places  -  Technologies 
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Ubique  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

□  Virtual  Places  -  Client 

□  Virtual  Places  -  Technologies 

•  Audio 

•  Video 

•  Animation 

•  VRML 

•  Intelligent  Agents  /  Extensions 
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Ubique  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

•  Protocol  &  Communication 

•  Multi  Servers 

•  Functional  Extensibility 

•  Shared  Code  Base 

•  API 

□  Virtual  Places  -  Client 

□  Virtual  Places  -  Technologies 


Support 


Technical  (^ 

Communication 
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Architecture  -  Shared  Code  Base 


^ 


^^ared 


VPserver 


VP©lient 
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Architecture  -  Shared  Code  Base 


otocol 


\ 


VPserver 
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Architecture  -  API  to  the  UI 


□  Easy  porting  to  new  platforms 

•  Windows  95 

•  Mac  T. 

•  Unix(?)  X\ 

□  Customized  UI 

□  Enhancement 

•  Animation 

•  Games 

•  Intelligent  Agents 


^Porting, 
Customization, 
Enhancement 
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Architecture  -  Server 


□  Groups  Server 

•  One  on  One  group 

•  Tour 

•  Lecture 

•  Ad-hoc  groups  /  Application  sharing 

□  "Data  Base"  Server  (Attributes) 

•  Group  name 

•  Objects 

□  Multi  server 

•  Shared  access  to  any  Web  server 

•  Load  Balancing 
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Architecture  -  Multi  Server 


Proxy  Farm 


y^ 


VPseKvers 
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Architecture  -  Multi  Server  Model 


□  Load  of  presences  should  r^  ^  O 


./•'' 


be  shared  between  many  ^ 

servers  to  create  huge  O  Ly^ 


communities  q  ^  q 


C 


O 


Q  Management  problems  ^      W^      ^^     ^.       ^ 


Finding/Creating  places  q 

Finding  a  presence 

Broadcasting  ^-^^^  O 


v^i 


o 


O     r     L^ 
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Architecture  -  Multi  Server  Model 


ifk     — w*»^*. 
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Server  Types 


Virtual  Places  Functionality 

Server  to  Server  connection 

Creation  of  new  places  by  Manager  demand 

Sends  updates  to  the  manager  e.g.  presence  leaves 

Queries  to  Manager 
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Server  Tasks 


Virtual  Places  Functionality 

Server  to  Server  connection 

Creation  of  new  places  by  Manager  demand 

Sends  updates  to  the  manager  e.g  presence  leaves 

Queries  to  Manager 

Keeps  updated  state  of  all  the  VP  servers 
Allocation  for  new  places  (load  balancing) 
Queries  and  answers  with  Central  Server 
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Server  Tasks 


Virtual  Places  Functionality 

Server  to  Server  connection 

Creation  of  new  places  by  Manager  demand 

Sends  updates  to  the  manager  e.g  presence  leaves 

Queries  to  Manager 

Keeps  updated  state  of  all  the  VP  servers 
Allocation  for  new  places  (load  balancing) 
Queries  and  answers  with  Central  Server 


Nominates  Cluster  Managers  to  open  new  places 
Distribution  node  of  Cluster  Manager  queries 
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Capacity  Analysis 


□  100  Virtual  Place  servers  with  3000  presences  each 
(depends  on  the  machine  capability) 

□  10  Clusters,  300,000  presences  per  cluster 


□  Total  of  3,000,000  presences  in  this  community 


1011  machines  to  create  a  Virtual  Place  Server  that 
supports  3,000,000  people  community. 
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Benefits 


□  Community  queries  can  be  answered  by  I'^^fi^ops  (without 
optimization) 

□  Modular/dynamic  enhancement  of  capacity 

□  Simple  algorithms  and  decision  making  -  fovF  pj^jv^/v  c    M  o. 

□  Full  control/monitoring  and  data  retrieval  about  the 
community  via  the  central  server. 

□  Simple  recovery  mechanism  -  "reactivate  and  update  your 
state" 


'■-o 
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Server  To  Server  Connection 
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Server  To  Server  Connection 


ii 


Atomic  transfer  of  groups 

One  connection  between  any  two  servers 

This  connection  can  be  permanently  open. 
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Architecture  Scheme 


Client  U 


^ot 


^coj 


Shared  Code 

Base  Configuration 

&  Control 


^' 


/^' 


Communicaliuii 
Manager 


«,i^*ry^'*''^^'v^^  ^^  ^ 


■■-J 


;?•:!-£ 


,«&^w^ 


*}^, 

i*,'<j^ 


Server 
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Communication  Manager 


□  Manages  client/server  communication 

•  Can  support  different  communication  protocols 

□  A  separate  module  —  easily  replaced 

□  Allows  the  server  to  handle  many  clients 

□  Optimizes  network  usage 
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Virtual  Place  Architecture 


□  Places  contain  presences  and  groups 

□  Presences  are  created  by  clients 

□  Places  are  updated  according  to  presences' 
requests 

□  Clients  mirror  the  places  of  their  presences 

□  The  server  controls  the  state  of  a  place 

□  A  client  accepts  a  snapshot  when  it  enters  a  place 

□  Incremental  place  state  changes  are  propagated  to 
clients  with  presences  in  the  place 
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Typical  Events 


□  Connecting  to  a  place 


□  Creating/joining  a  group 


<-.   ir^ii      ^ 


.1 


I 


C\t 


□  Moving  between  groups 
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Connecting  to  a  Place 


□  Client  C  sends  connect  request 

□  Server  adds  presence  P  of  C  to  the  place 

□  Server  sends  snapshot  to  C 

□  Server  propagates  "presence-entered(P)"  event 

□  Client  C  creates  (local)  place  from  snapshot 

□  Clients  add  P  to  (local)  place 
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Creating/Joining  a  Group 


« 


0/ 


□  Presence  P  sends  request  to  server 

□  If  request  approved  by  server: 

•  Server  updates  place  state 

•  Server  propagates  an  event 

•  Clients  update  (local)  place  state 

□  If  request  denied  by  server: 

•  Reject  message  is  sent  to  P 
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Moving  between  groups  % 


-'  —^ 


□  Presence  P  sends  a  request  to  move  into  a  group 
(and  position/slot  within  this  group) 

□  Server  updates  place  state 

□  Server  propagates  an  event 

□  Clients  update  place  state 
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Place  Capacity 


'  '  V. 


\-V,\ 


□  Requirements 

•  Limited  by  resources  and  to  preserve  clarity 

•  On  the  other  hand,  we  want  to  enable  everyone  to  at  least 
view  the  place 

□  Implementation 

•  A  place  is  composed  of  a  room  and  a  corridor, 

•  Active  presences  -  inside  the  room  (limited) 

•  Passive  presences  -  in  the  corridor  (unlimited) 

.    Can  view  place 

•  Can  enter  the  room 

•  Cannot  interact  with  other  presences 

□  Optimization 

Presences  are  not  aware  of  other  passive  presences 
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VP  Implementation 


□  Object  Oriented,  in  C++ 

□  Places  are  composed  of  presences  and  groups 

□  Place,  Room  &  Corridor  are  special  kind  of  groups 
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VP  Class  Hierarchy 


I 


Position  Group 


1 


Oredered  Group 


Room 


I 


Corridor 


Place 
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VP  Interface 


□  Main  object  is  Place 

□  Client  creates  a  Place  instance  per  window 

•  Along  with  a  "room",  a  "corridor"  and  a  "myself 

□  Interface  from  application  to  VP  via  methods  of 
VP  classes 

□  Interface  from  VP  to  application  via  virtual 
methods 

•  Informing  on  state  change  events 

•  Specifically,  creating  places  members  (groups  and  presences) 
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UMque  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

□  Virtual  Places  -  Client 

•  Client  Architecture  Support 

•  Features 

•  UI 

•  Porting  Technical  c>V 

□  Virtual  Places  -  Technologies  Communication 
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Client  Architecture 


r 


IJii^^  Siuiiii^i^ 


Browser 


VPclient 
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Client  Architecture 


r 


\kiija  ^iiriii^f^ 


.Ji4;S^hJ>: 


egenc  es 


Browser 


'--'^^> 


'~'3ff*r^.-''r'«r**^' 


VPclient 
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Client  Architecture 


Gl 


"il^^  Siijfiiljf:; 


Browser       -^ 


Get  URL 


Positioning 


Set  URL 


^     VPclient 
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Client  Architecture 
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Typical  Event  Flow 


VP  Server 


Virtual  Places 

API  -  Shared  Code  Base 


Virtual 
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Client  Architecture 


Two  implementations  models  to  add  to  YP-enable 
browser: 

□  By  hooking  -  Operating  System  Integration 


□  By  integration  -  Application  Integration 
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Two  Implementation  Models 


□  By  Integration 

•  WWW  browser  Links  to  a  DLL  which  implements  the  screen 
presences 

•  The  VP  tool  box  is  an  integral  part  of  the  browser  GUI 

□  By  hooking 

•  All  VP  activity  is  implemented  as  a  separate  application. 

•  The  communication  between  the  VPclient  and  the  browser  (URL, 
Positioning)  is  done  by  using  conventional  (Navigator  API,  SDI) 
or  non-conventional  (Hooks)  methods 
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By  Integration 


Client  API 
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Minimal  VPClient-Browser  protocol 


URL 

UINT  Connect  (URL)  -  Set  VPC  place  (URL). 
UINT  GoTo(URL)  -  Set  the  Browser  URL. 

Positioning 

void  AttachTo(window)  -  The  window  in  which  the  VPC  should  render, 
void  SetSize(size)  -  The  size  of  the  attached  window  (document), 
void  SetOffset(size)  -  The  offset  of  the  attached  window, 
void  RefreshO 

Control 

UINT  InitializeO  -  Initialize  the  dll. 
UINT  TerminateO  -  Terminate  the  dll. 
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By  hooking 


Virtual  Places 
Client 


Virtual  Places 
Implementation 


,    -.  >''-;/.;^=>L';  -*-J-,i?...!-.>. -.,.■-»■.,-:..  -   ..■    =-.■ 

WWW 

Navigator 

Navigator  API 

, ^ 

OS  Hooks       1 

I J 

Navigator  API:  CCI  (Mosaic),  SDI  (Spyglass,  Netscape) 
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Methods  Comparison  Table 


Entity 

By  Integration 

By  hooking 

Applications 

'- 

2 

Integration  Effort 

Major 

Minor 

Positioning 

Document  relative 

Viewport  relative 

OS  dependency 

Minor 

Major 

Extensibility 

Low 

High 

UI 

Re-design 

Standard  VP  design 
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Implementation  Notes  (PC) 


□  Object-oriented  methodologies 

□  32  bit  programming  model  (16  bit  -possible)  with 
respect  to  Win32s 

□  Implementation  using  a  C++  Framework  (MFC) 

□  Visual  C++ 2.x 

□  Remote  Windows  3. IX  debugging 
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Client'tO'Client  Connections 


Client  "A" 


Audio/Data/Video 


VP 

Protocol 


VP  server 


Client  "B" 


VP 

Protocol 


©Copyright  1995,  Ubique  Ltd. 


70 


Ubique  Confidential      8/13/95 


Ubique  R&D  -  Structure  &  Tasks 


□  Virtual  Places  -  Architecture 

□  Virtual  Places  -  Client 

□  Virtual  Places  -  Technologies 

•  Audio 

•  Video 

•  Animation 

•  VRML 

•  Intelligent  Agents  /  Extensions 


Support 


Technical  (^ 

Communication 
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Technologies  &  Extensions 


Virtual  Places  is  a  natural  platform/application  environment  which 
enable  to  easily  extend  human  capabilities  in  a  virtual  place 

□  Audio/Video 

□  Animation  -  human  gestures 

□  Extensions  (Intelligent  Agents) 

□  VRML  (3D  Clients) 
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Audio  (Video)  Architecture 


I'hique  \iidi<i  l-Aleiisi(i  i 

Control  Panel 

Diagnostics 

Invoke 

Start  +  IP  addresses 

Stop 


Configure  extension 


Can  be  in  a  separate  Installation 
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Animation 


□  Enrich  gestures 

□  More  fun  /  games 


w^ 


□  Implemented  above  VP 
API 

□  Prototyping 
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lU'  ' 
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Animation 


n 


Pre-defined  Animation  Library 


gesture  tokens 
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Extensions  -  scheme 


VPserver 


©Copyright  1995,  Ubique  Ltd. 


77 


Ubique  Confidential      8/13/95 


Extensions  -  Visual  Basic 
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Visual  Basic  Extensions  -  Examples 


y  Guided  tours 

^  Graphical  scriptor  for  intelligent  agents 

nl^ 

^^J^ 

V  Answering  machines 

r 

m 

/The  Virtual-Press-Conference  Kit 

/Games:  Bridge 

Li  Limited  natural  language  processing 

□  Screening 

LI  Canned  interactions 

status:  Prototype  level 
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Extensions  -  Games 
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VRML 


□  Virtual  Places  for  VRML  requires  tight  integration 
with  VRML  Browser 

□  VPA^RML  API  requires  injection  and 
manipulation  of  3D  objects  in  a  VRML  scene 

□  Ubique  is  involved  in  creating  an  API  for 
interactive  VRML  (2.0) 

□  A  prototype,  based  on  WebSpace  (SGI  platform) 
and  VP-API  is  under  development. 
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